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(57)Abstract 

PROBLEM TO BE SOLVED: To ensure high image 
quality and to attain high speed processing while 
reducing power consumption. 

SOLUTION: In the signal processing method for moving 
image information for motion compensation prediction 
between two images apart in time series, the process of j 
a block matching in an unretrieved area after a 
difference absolute sum of pixels being an index for 
detecting a motion vector reaches at first a prescribed 
threshold value is forcibly terminated. Thus, possible 
excess signal processing is excluded in a range of 
keeping sufficiently high image quality and the power 
consumption of a difference absolute sum array 8 
calculating a difference absolute sum is realized. The 
difference absolute sum array 8 is provided with a 
comparator circuit 9 that sequentially compares the 
calculated difference absolute sum with a prescribed 
threshold level and the comparator circuit 9 provides a 
prescribed output when the difference absolute sum 
reaches the prescribed threshold level. 
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JPO and NCIPI are not responsible for any 
damages caused by the use of this translation. 

l.This document has been translated by computer. So the translation may not reflect the original precisely. 
2 * * * * shows the word which can not be translated. / 
3. In the drawings, any words are not translated. 



DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This inventions are the signal-processing approach of the dynamic-image information 
based on the high compression of a dynamic image, and the high quality processing (MPEG) 2, for example, 
MPEG, and its equipment, and a thing concerning amelioration of the processing-process technique of motion 
vector detection especially. 
[0002] 

[Description of the Prior Art] Although the technique about signal processing of dynamic-image information 
huger than before is examined from the many-sided include angle, the amount of signal processing of the 
dynamic-image encoder based, for example on MPEG 2 projects and has the large motion vector detection 
processing in motion compensation prediction. Although this motion vector detection processing results in 
detection of the motion vector which paid its attention to the central motion between two images isolated 
serially, all the so-called heuristics for which it searches per macro block about all the range of the seek area of 
a playback image to the reference field (reference macro block) of the present image as this kind of a 
fundamental technique is known. 

[0003] However, all the above-mentioned heuristics is only means which are faithful to radical Motohara ** 

called high definition also until it gets tired, and it deviates from the purpose of reduction of throughput 

indispensable to a real-time operation, as a result implementation of low-power-izing. 

[0004] As the nearest technique, so-called 2 step hierarchy heuristics which narrowed the retrieval range of a 

motion vector on the two-step target was proposed by for example, the Nikkei electronics February 10 issue 

(1997 special edition LSI (ERUESUAI) report) from this viewpoint. 

[0005] 

[Problem(s) to be Solved by the Invention] However, since the above-mentioned 2 step hierarchy heuristics is 
the technique of making the part of four corners distant from the core of an image from the beginning the 
outside of the object of the retrieval range irrespective of the existence of the core of a motion, it cannot say it 
as the solution means of ultimate high-definition pursuit. 

[0006] Moreover, although the configuration of the window region for which it searches is set as a rhombus as a 
concrete means which narrows the retrieval range, since formation of the demarcation field which meets the line 
of unnecessary slant with the usual technique is needed for the above-mentioned contents of a proposal with this 
means, it is inevitable to produce new problems, such as complication of a circuit design and pixel addressing, 
power consumption increase at the time of processing actuation, and a production cost side. 
[0007] In addition, although the 3 step method which is indicated by G5.3.1 - G5.3.5 grade is learned as a 
technical-problem solution means of all the above-mentioned heuristics in IEEE (IEEE), the National 
telecommunication conference, four volumes, November, and 1981 This technique is the technique chiefly 
developed for the image processing near a static image like the television conference, and is not what was 
suitable for the image processing corresponding to an NTSC (National television system committee) method at 
least. 

[0008] Aiming at high-speed processing pointing [ are made in order to solve the technical problem of the 
above-mentioned conventional technique, and ] to reduction of power consumption, moreover, it can secure 
high definition and this invention aims at offering the signal-processing approach of the dynamic-image 
information carried out with complication of circuitry, and its equipment. 
[0009] 



[Means for Solving the Problem] The main configuration of this invention for attaining the above-mentioned 
purpose the difference of the pixel value used as the index of detection of a motion vector - by forcing the 
process of block matching by subsequent non-seek areas to terminate, when the absolute value sum becomes a 
predetermined threshold region In the signal-processing approach of the dynamic-image information for 
presenting performing motion compensation prediction between two images serially isolated based on the idea 
of eliminating excessive signal processing as much as possible, in the range which can maintain sufficient high 
definition The process which positions the short range retrieval aperture in the wide range retrieval aperture 
from which said motion compensation prediction was selected within the playback image, Between the 
reference macro blocks by which the location was carried out about the collating macro block by which a 
sequential setup is carried out within said short range retrieval aperture in order to have been referred to within 
the present image the difference of the pixel values to which each macro block corresponds - the difference 
based on an absolute value - with the process of block matching which calculates the absolute value sum the 
difference calculated about each collating macro block in said short range retrieval aperture by which the 
location was carried out, when the absolute value sum reaches a predetermined threshold The 1st forced- 
termination process which forces the process of said block matching in the short range retrieval aperture 
concerned to terminate, the difference which operated sequentially about each collating macro block by which a 
sequential setup is carried out from the wide range retrieval aperture which is the extended partition of said 
short range retrieval aperture, when the absolute value sum reaches said predetermined threshold The 2nd 
forced-termination process which forces the process of said block matching in the wide range retrieval aperture 
concerned to terminate, The 3rd forced-termination process which considers the time of all the processes of said 
block matching in all the fields in said wide range retrieval aperture being completed as the time of forced 
termination of said block matching, difference when said predetermined threshold is reached - it is 
characterized by including the process which detects the motion vector which is the two-dimensional movement 
magnitude to the location of said reference macro block of the location of the prediction macro block defined as 
a collating macro block in case the absolute value sum serves as min. 

[0010] Furthermore, while other main configurations of this invention are for realizing the above-mentioned 
technique more concretely and specifying a wide range retrieval aperture from the inside of a playback image 
The control section which specifies the reference macro block for being referred to within the present image, 
Between the data memory which memorizes said wide range retrieval aperture, a series of pixel value groups 
obtained from the collating macro block by which a sequential setup is carried out in order to perform the 
retrieval concerned for said every selected wide range retrieval aperture, and a series of pixel value groups 
obtained from said reference macro block It has an absolute value sum array, the difference based on the 
difference of corresponding pixel values - the difference which calculates the absolute value sum - In the 
signal processor of the dynamic-image information constituted so that the motion vector which is the two- 
dimensional movement magnitude of the prediction macro block location which was specified from the absolute 
value sum at the time of the retrieval concerned to said reference macro block location, and which is defined as 
a collating macro block might be detected the calculated this difference — The extract section which extracts 
said selected short range retrieval aperture by which a location is carried out for every wide range retrieval 
aperture, The selector which outputs alternatively the wide range retrieval aperture which is the extended 
partition of the extracted this short range retrieval aperture or this short range retrieval aperture, The side 
register which memorizes serially the part in which the collating macro block by which a sequential setup is 
carried out is included in order to perform said retrieval at least among the short range retrieval aperture 
outputted from this selector, or a wide range retrieval aperture, the difference which operated sequentially about 
each collating macro block - with the comparator circuit which carries out the sequential comparison of the 
absolute value sum with the predetermined threshold set up beforehand The counter which carries out counting 
of the sequence of said collating macro block by which a sequential setup is carried out is formed. Said 
comparator circuit the difference which operated sequentially within the short range retrieval aperture 
concerned, when the absolute value sum reaches a predetermined threshold or the difference which operated 
sequentially about each collating macro block by which a sequential setup is carried out from said wide range 
retrieval aperture, when the absolute value sum reaches said predetermined threshold While outputting a 
predetermined output signal, said counter is characterized by constituting so that said control section may 
compute the vector quantity of said motion vector according to the output of this sequence by outputting the 
sequence of a collating macro block of having reached said predetermined threshold. 



[0011] 

[Example] Drawing 1 shows one example of the equipment for enforcing the approach of this invention. This 
example shows the circuitry of the motion vector detection in signal processing of dynamic-image information 
which motion-compensation-predicts, divides and serves as the nucleus, and the profile configuration is carried 
out from the data-processing section 1 and a control section 2. 

[0012] the data-processing section 1 - the extract circuit 5, data memory 6, a selector 59, and difference -- the 
absolute value sum array 8, the side register 7, the comparator circuit 9, and the counter 10 grade are prepared. 
The pixel data of the frame memory 4 (720x480 pixels is memorized) of a playback image are supplied to the 
extract section slack short range retrieval aperture extract circuit 5 and the data memory 6 (one piece memorizes 
the aperture for wide range retrieval for 48x48 pixels) for wide range retrieval apertures which contain counter 
ability according to the control program which constitutes a control section 2. moreover, the control program 
with which the pixel data of the frame memory 3 (720x480 pixels is memorized) of the present image constitute 
a control section 2 - following — for example, one piece - the reference macro block for 16x16 pixels — 
difference - the absolute value sum array 8 is supplied. 

[0013] The short range retrieval aperture extract circuit 5 can specifically carry out now suitably the shift by the 
retrieval of the wide range retrieval aperture which is the extended partition from retrieval of a short range 
retrieval aperture so that the data of a 32x32-pixel short range retrieval aperture may be extracted, a selector 59 
may be supplied and a selector 59 may output alternatively the data of the above-mentioned short range 
retrieval aperture, and the data of a wide range retrieval aperture. In addition, the data of the above-mentioned 
short range retrieval aperture are supplied to the side register 7, while the data of a wide range retrieval aperture 
are written in the data memory 6 for wide range retrieval apertures. 

[0014] the side register 7 - for example, the data for 32x16 pixels - it can hold - coming --****- difference - 
- while inputting every 1 pixel new data from a selector 59 in the case of data processing in the absolute value 
sum array 8, every 1 pixel processed data are discharged. 

[0015] the data of the 16x1 6-pixel collating macro block which is a part of short range retrieval aperture which 
serves as a part in the present image which attracts attention according to the control program which constitutes 
a control section 2 from a frame memory 3 of the above-mentioned present image, and which the data of a 
16x1 6-pixel reference macro block were read, for example, and was memorized by the above-mentioned side 
register 7 — difference - the absolute value sum array 8 is supplied. 

[0016] difference - the difference of the corresponding pixels of the pixel value of 16x16 pieces whose 
absolute value sum array 8 is data of a reference macro block, and the pixel value of 16x16 pieces which is data 
of a collating macro block - total of an absolute value is calculated and outputted. Here, each pixel value 
consists for example, of a 8-bit luminance signal, respectively. 

[0017] difference - the output WD of the absolute value sum array 8 is measured with the predetermined 
threshold R which is supplied to a comparator circuit 9 and set up suitably, moreover, difference - counting of 
the sequence Ii that the output WD of the absolute value sum array 8 appears is carried out by the counter 10. 
For example, when the above-mentioned output WD is larger than a threshold R, while a comparator circuit 9 
outputs an output signal 0, when the above-mentioned output WD is below the threshold R, a comparator circuit 
9 outputs an output signal 1. If the sequence of a collating macro block when an output signal 1 is acquired is 
outputted through a counter 10, according to the output of this sequence, the positional information output of a 
prediction macro block is obtained, and the vector quantity of a control-section 2 lost-motion vector can be 
known. 

[0018] The above-mentioned control section 2 governs all control that makes a nucleus the above-mentioned 
data-processing section 1, and specifically performs a wide range retrieval aperture, reference macro block, 
addressing of a short range retrieval aperture, calculation of the vector quantity of a motion vector, etc. 
[0019] here -- the above-mentioned threshold R - for example, the difference which selected said wide range 
retrieval aperture in the screen (intra picture) of coding in a screen, and was obtained for every wide range 
retrieval aperture about all the range of said present image - the minimum value of the absolute value sum, the 
average, or this difference - it is the tolerance about the minimum value or the average of the absolute value 
sum. moreover, the difference from which the above-mentioned threshold R was acquired for every wide range 
retrieval aperture about all the range of the last present image - you may be the minimum value of the absolute 
value sum. In addition, the above-mentioned threshold R is a proper period, for example, it may be set up so 
that it may update for every appearance spacing of the screen of the above-mentioned coding in a screen. In any 



[ said ] case, the tolerance about the minimum value or the average is sufficient. 

[0020] drawing 2 - the above -- difference - what shows the more concrete example of the absolute value sum 
array 8 - it is -- this difference - the absolute value sum array 8 consists of the 1st block 1 1 and the block 12 of 
the 2nd. It has the absolute value sum arithmetic circuits 13-28 (16 lines), the 1st block 11-16 pixels - 
difference - each arithmetic circuits 13-28 Respectively The above-mentioned short range retrieval aperture or 
the 1st of a wide range retrieval aperture - or The data CD1 1-CD161 of the 1st thru/or the 16th line of the 
reference macro block corresponding to the data SD1 1-SD161 of the 16th line, --SD1 16-SD1616, and each 
SD1 1-SD161, --SD1 16-SD1616 and -CD1 16-CD1616 are inputted, two adjoining data per line - a pyramid- 
like product raising addition method — parallel addition - carrying out - 16 lines — per - the difference for 16 
pixels of each - the data LD1-LD16 of the subtotal aggregate value which is the absolute value sum are 
obtained. 

[0021] drawing 3 - 1 pixels [ 16 ] among each arithmetic circuits 13-28 - difference - what shows the example 
of a configuration of the absolute value sum arithmetic circuit 13 — it is - this arithmetic circuit 13 - 16 sets of 
difference - it has the absolute value computing elements 1 19-134. each - difference - the absolute value 
computing elements 1 19-134 are connected to the input registers 151-166 which cany out storage maintenance 
of the data CD1 1-CD161 of the Norikazu ream when it corresponds to the input registers 135-150 which carry 
out storage maintenance of the data SD11-SD161 of the 1st line of the above temporarily, and each data SD1 1- 
SD161 temporarily, respectively, each difference - the absolute value computing elements 1 19-134 - the 
difference of each data CD1 1-CD161, each data SD 1 1 - SD161 comrades - an absolute value calculates. 
[0022] in addition - drawing 3 - difference - the absolute value computing elements 1 19-134 etc. mean 
typically processing the above-mentioned 8-bit luminance signal, respectively in one notation, in order to 
simplify illustration, concrete - each - difference - each bit of the absolute value computing elements 1 19-134 
should be understood as that by which the profile configuration was carried out, for example from one full 
adder and two exclusive OR gates, respectively. For example, data CD 1 1 (binary number data) and Data SD 
(binary number data) are inputted. Next, the two's complement (the one's complement of Data SD and sum of 1) 
of Data SD is inputted, and the difference of both data is calculated, subsequently— if an exclusive OR with 
MSB (most significant bit) is taken for every bit to all the bits of the output - difference - an absolute value is 
obtained. 

[0023] thus, the obtained difference - after sequential storage maintenance of the 1 ** is carried out at the 
pipeline registers 167-182 of the 1st step, as for each absolute value, two adjoining data are added with eight 
adders (only one adder 183 is illustrated) of the 1st step, respectively. Subsequently, after sequential storage 
maintenance of the aggregate value which is the output of the adder of the 1st step is carried out at the pipeline 
register (only pipeline registers 184 and 185 are illustrated) of the 2nd step, two adjoining data are added with 
four adders (only one adder 186 is illustrated) of the 2nd step, respectively. 

[0024] Parallel addition is performed by the pyramid-like product raising addition method like the following. 
Namely, storage maintenance to the pipeline register (only pipeline registers 187 and 188 are illustrated) of the 
3rd step and addition with two adders (only one adder 189 is illustrated) of the 3rd step are performed. Then, 
storage maintenance to the pipeline registers 190 and 191 of the 4th step and addition with one adder 192 of the 
4th step are performed, the difference for 16 pixels - storage maintenance of the absolute value sum is carried 
out at a pipeline register 193, and, finally the subtotal aggregate value data LD 1 are outputted from the 5th step 
pipeline register 193. 

[0025] 16 lines shown in drawing 4 - the subtotal aggregate value accumulation circuit 29 - the above- 
mentioned 16 pixels each - difference - inputting the above-mentioned subtotal aggregate value data LD1- 
LD16 which are the outputs of 13 to absolute value sum arithmetic circuit 28 arithmetic circuit, and carrying out 
parallel addition of the two adjoining data by the pyramid-like product raising addition method - the above - 
difference - the total data WD of an absolute value are outputted. 

[0026] That is, the above-mentioned accumulation circuit 29 inputs the subtotal aggregate value data LD1- 
LD16 from the 1st block 1 1 into every the eight 2-set adders 194-201 of the 1st step, acquires the aggregate 
value of eight pieces and inputs these into the 1st step pipeline registers 202-209 one by one. It makes the 
output of the 1st step pipeline registers 202-209 into 2 more sets at a time, and is inputted into four adders (only 
one adder 210 is illustrated) of the 2nd step, and the aggregate value which is each result of an operation is 
inputted into the 2nd step pipeline register (only pipeline registers 21 1 and 212 are illustrated) one by one. 
[0027] Like the following, parallel addition by the pyramid-like product raising addition method is performed, 



and after making the output of the 2nd step pipeline registers 211-212 into 2 more sets at a time, inputting into 
two adders (only one adder 212 is illustrated) of the 3rd step and acquiring an aggregate value, storage 
maintenance to the 3rd step pipeline registers 214 and 215 and addition with one adder 216 of the 4th step are 
performed. Finally the aggregate value acquired with the adder 216 of the 4th step is outputted to an output 
register 217 as the above-mentioned total data WD, after storage maintenance is carried out. 
[0028] Since this example is constituted as mentioned above, at the process of the location of a short range 
retrieval aperture, a wide range retrieval aperture is read from the playback image frame memory 1 by 
addressing of a control section 2, and it is memorized by data memory 6. While this read-out is performed, the 
short range retrieval aperture in the above-mentioned wide range retrieval aperture is extracted in the extract 
circuit 5, and, as for this short range retrieval aperture, that part is memorized by the side register 7 through a 
selector 59. some short range retrieval apertures which preceded other parts of the short range retrieval aperture 
which was not memorized by the side register 7, and were memorized by the side register 7 - the collating 
macro block for 16x16 pixels which are a part at an inner pan ~ difference - it waits and supplies that data 
processing is carried out by the absolute value sum array 8. 

[0029] on the other hand, from the present image frame memory 3, the reference macro block for 16x16 pixels 
outputs by addressing of a control section 2 - having --**** ~ the above-mentioned collating macro block - 
difference - the absolute value sum array 8 is supplied, the difference of the pixel values to which each macro 
block corresponds by this - the process of block matching which calculates an absolute value is performed. 
[0030] the difference in the process of this block matching ~ every collating macro block selected by the 
operation of an absolute value - difference - the difference which operated sequentially although total of an 
absolute value was outputted - if either becomes the predetermined threshold R among the absolute value sums 
at the beginning, the output of an output signal 1 will be obtained from a comparator circuit 9 at that time, and 
the operation in the short range retrieval aperture concerned will be ended. It is the case where the 1st forced- 
termination process that this forces block matching to terminate is performed, and the collating macro block at 
the forced-termination time turns into a prediction macro block set as the object of motion vector detection. 
[0031] difference when the technique by all so-called conventional retrieval is used for drawing 5 - the relation 
between the absolute value sum and the number of block matching is shown. If it all searches for a wide range 
retrieval aperture, the number of block matching will become Q2 time, it is shown in a curve (a) ~ as ~ 
difference - in spite of calculating the minimum value MinADl of the absolute value sum, since retrieval is 
continued, it specifies performing excessive processing exceeding QA time at least. 

[0032] drawing 6 - as the example of an experiment - difference - the case of the approach of this invention 
which is the graph which shows the relation between the absolute value sum and the count of block matching, 
and is shown with a curve (b) - difference, since the count of block matching to which the absolute value sum 
reaches a threshold R is QB time If it compares with the count becoming Q2 time when searching about all the 
range of the wide range retrieval aperture beforehand selected like a conventional method, only the part which 
lengthened QB time from Q2 time can be managed with a small count. 

[0033] The curve (c) shown in drawing 6 , (d), and (e) show the example when in addition not reaching a 
threshold R, even if it searches about all the range of the short range retrieval aperture by which the location 
was carried out [ above-mentioned ]. In addition, the inside Ql of this drawing is the count from which the 
number of block matching in a short range retrieval aperture serves as max. the case of a curve (c) - a short 
range retrieval aperture - difference - since the absolute value sum is not less than a threshold R, it is the 
example which extends the retrieval range to a wide range retrieval aperture like the conventional technique, 
and continues an operation. That is, it is the case where the 2nd forced-termination process is performed. In this 
case, since a threshold R will be reached if the count of block matching is set to one Qc, block matching is 
forced there to terminate. In this example, only the part which lengthened two Qc(s) from Q2 time can be 
managed with a small count. 

[0034] In a curve (d) and (e), it is what shows the case where a threshold R is not reached even if it searches 
about all the range of a seek area. In such a case difference -- at the time of Qd time which is a time of reaching 
MinAD which is the comparison minimum value like a curve (d), when it comes to be considered that the 
absolute value sum is min or min Or it considers as a prediction macro block with the collating macro block at 
the time of Q2 time which is the maximum count extended to the wide range retrieval aperture like a curve (e). 
That is, it is the case where the 3rd forced-termination process is performed. 

[0035] In addition, you may make it set up a threshold region so that it may have the width of face delta which 



it not only sets up one threshold R 5 but extended the threshold up on both sides of the above-mentioned 
threshold R as shown in drawing 6 , or the width of face delta which narrowed the threshold caudad. If such a 
tolerance slack threshold region is set up, the count of block matching will turn into a curve (b) and a part to 
have lengthened the count [ of little ] gamma time from QB time about (c), respectively, or to have added, and a 
count to have lengthened the count [ of little ] delta time from Qc time, or to have added. By having given width 
of face delta to a setup of such a threshold R, condition relaxation of forced termination of block matching is 
attained, flexibility is given to block matching processing, and this processing can be performed efficiently. The 
width of face delta of the above-mentioned threshold region is suitably set up in the range which can prevent 
deterioration of image quality. 

[0036] Drawing 7 is the example of an experiment which showed the relation of the mean difference part 
absolute value sum and the count of average block matching which were obtained by the technique of all 
conventional retrieval, and the approach of this invention, and which were standardized, it is shown in this 
drawing - as — the case of this invention — Qc (about 600 times) - min - difference — being saturated with the 
twice as many abbreviation [ as this ] Qd (about 1200 times) in the case of a conventional method is shown to 
the absolute value sum being saturated. Such a twice as many gap as this has the following meaning. 
[0037] the difference of this example — if the power consumption P of a CMOS logical circuit uses the 
frequency f of a clock when the absolute value sum array 8 is constituted from a CMOS (C MOS) logical circuit 
-[0038] 

[Equation 1] P=nfCV2 [0039] Since it is alike and what is expressed is known, if clock frequency f can be 
adjusted low, you can understand that power consumption P can be reduced. In addition, in the number 1 above- 
mentioned formula, n is [ the average load capacity of each logic gate and V of the number of logic gates and 
C ] supply voltage. Clock frequency f is proportional to supply voltage V and the count Q of the above- 
mentioned block matching. 

[0040] From such relation, supposing it reduces Q to 1 for N, clock frequency f can also be reduced to 1 for N. 
Furthermore, since clock frequency f is set to 1 for N, supply voltage V is good at 1 for N. The power 
consumption P0 in this case is [0041]. 

[Equation 2] P0=n(£W)C(V/N)2=P/N3 [0042] It can express. That is, like relation as shown, for example by 
drawing 7 , supposing it reduces Q to 1/2, he can understand that new power consumption drops to 1/8 before 
reduction of that. 

[0043] If a prediction macro block is selected from block matching of a seek area as described above, the 
process which detects the motion vector which is the two-dimensional movement magnitude to said reference 
macro block location corresponding to this will be performed. 

[0044] In addition, even if it compares it when the technique of above-mentioned this example is use and the 
technique of all conventional retrieval is use for the index of the image quality of a playback image (what is 
show with a curve (0)), as show, for example in drawing 10 (what is show with a curve (4)) although it can be 
quantitatively express with the mean difference part absolute value sum to the number of pixels of the retrieval 
range, it is prove experimentally that it is almost same. 

[0045] Drawing 8 and drawing 9 explain the example which improved the above-mentioned example further, 
respectively so that they may aim at much more improvement in the image quality of a playback image. 
[0046] When you select a wide range retrieval aperture in the case of the example shown in drawing 8 , it is 
going to consider the information on motion vector U of the reference macro block acquired immediately 
before, and let the location which only the part of the last wide range retrieval aperture location lost-motion 
vector U moved be a new wide range retrieval aperture. Thereby more exact and high-speed block matching 
processing can be performed. 

[0047] the process which block matching forces to terminate in the case of the example shown in drawing 9 - it 
is ~ difference - the threshold R of the absolute value sum - adding ~ the difference concerned — it is going to 
consider the percentage reduction of the absolute value sum. namely, difference — the absolute value sum is 
below the threshold R, and it is going to pay its attention to the number Qg of block matching when this 
percentage reduction becomes a zero value (straight line g). Thereby more exact block matching processing can 
be performed. 

[0048] in addition, the others whose percentage reduction is a zero value in this case - the difference obtained 
one by one in the operation process concerned when it became that tolerance - the time of it coming to be 
considered that the percentage reduction of the absolute value sum is a zero value, its tolerance, or min is 



included. 

[0049] Block matching processing possible [ the configuration which seasoned coincidence with the example 
shown in drawing 8 and drawing 9 ] natural, thereby more much more exact, and high-speed can be performed. 
Drawing 10 is a graph which shows the comparison with each above-mentioned example and the technique of 
all conventional retrieval, and a curve (1), (2), and (3) are drawn so that it may be located between the above- 
mentioned curve (0) and (4). A curve (1) is the case where it corresponds to the example shown in drawing 8 , 
and a curve (3) when a curve (2) corresponds to the example shown in drawing 9 corresponds, when both the 
examples shown in drawing 8 and drawing 9 are considered. 

[0050] It is good to include the same as that of said short range retrieval aperture and a wide range retrieval 
aperture in the screen of the above-mentioned coding in a screen for example, or the screen of front predicting 
coding, or the process which positions the amendment retrieval aperture of the field of different magnitude as 
the technique of setting up a threshold with the optimal above-mentioned threshold R. in this case, the 
difference of the pixel values correspond in each macro block between the reference macro blocks by which a 
location was carried out about the collating macro block by which a sequential setup is carried out within this 
amendment retrieval aperture in order referred to within the present image ~ the difference based on an absolute 
value ~ the difference obtained at the process which performs the process which performs block matching for 
calculating the absolute value sum, and performs this block matching - the minimum difference of the absolute 
value sums ~ the process which elects the absolute value sum carries out. all the difference obtained for said 
every process to elect while taking lessons for this process to elect from all reference macro blocks by which a 
location is carried out and carrying it out in the screen of said present image - the minimum value of the 
absolute value sums, or said all difference ~ the process which sets up the tolerance about the average, this 
minimum value, or the average of the absolute value sum as a new predetermined threshold is included. 
[0051] the difference at the time of this invention not being limited to the above-mentioned example, and the 
forced-termination process of the above 3rd being performed ~ the case where the absolute value sum does not 
reach said predetermined threshold R - the field of the above-mentioned wide range retrieval aperture in the 
field Of the above-mentioned playback image - gradually — extending ~ every [ the ] extended new retrieval 
range ~ respectively - alike - attaching ~ difference ~ it is possible to also include the process which judges 
whether the absolute value sum reached said predetermined threshold 

[0052] moreover ~ for example, the above-mentioned predetermined threshold R is acquired when any one 
process in said 1 st forced-termination process, the 2nd forced-termination process, and the 3rd forced- 
termination process is performed among all reference macro blocks specified by the last present image ~ each - 
difference ~ it is also possible to consider as the minimum value of the absolute value sum or the tolerance of 
this minimum value. 

[0053] furthermore, the difference from which said predetermined threshold R is acquired when any one 
process in said 1 st forced-termination process, and the 2nd forced-termination process and the 3rd forced- 
termination process is performed between the last reference macro blocks - the absolute value sum - or - this - 
- difference ~ considering as the tolerance of the absolute value sum is also possible. 

[0054] " . 

[Effect of the Invention] Since excessive block matching processing is eliminated according to invention of 
claim 1 as explained above Sharp reduction of the power consumption in the MPEG 2 dynamic-image encoder 
with which especially technical-problem solution is desired is enabled. While high-speed processing is 
realizable as a result, the retrieval range is not limited from the beginning like the above-mentioned 
conventional 2 step hierarchy heuristics, difference which reaches a threshold at least ~ since block matching is 
performed until the range where the absolute value sum becomes min is searched - the conventional base - the 
high definition which may also equal the technique of all theoretic retrieval enough is obtained. And since a 
setup of an easy threshold region is only added technically, it is not accompanied by complication of circuitry. 
[0055] According to invention of claim 2, since the optimal thing is decided among predetermined thresholds, 
since the technique of a setup of a threshold agrees in actual time varying image processing, it is suitable, and 
the effect of the invention of claim 1 can be improved further. 

[0056] According to invention of claim 3, since a threshold can be set up more exactly and quickly, in addition 
to the effect of the invention of claim 1 , it can contribute to the improvement in image quality further. 
[0057] According to invention of claim 4, since a threshold can be set up further further more exactly and 
quickly compared with invention of claim 3, in addition to the effect of the invention of claim 1, it can 



contribute to the improvement in image quality further. 

[0058] According to invention of claim 5, since the threshold region in forced termination of block matching 
becomes a two-step target, in addition to the effect of the invention to claim 1 thru/or claim 4, much more 
improvement in image quality can be aimed at. 

[0059] According to invention of claim 6, since it can carry out easily [ selection of a wide range retrieval 
aperture important for processing of forced termination of block matching ] 5 exactly moreover, and quickly, in 
addition to the effect of the invention to claim 1 thru/or claim 5, it can contribute to count reduction of block 
matching processings. 

[0060] Since according to invention of claim 7 it can carry out easily [ selection of a wide range retrieval 
aperture ], exactly moreover, and quickly while the threshold in forced termination of block matching becomes 
a two-step target, in addition to the effect of the invention to claim 1 thru/or claim 4, it can depend including 
count reduction of block matching processings, and much more improvement in image quality can be aimed at. 
[0061] According to invention of claim 6, since it can carry out easily [ selection of a wide range retrieval 
aperture important for processing of forced termination of block matching ], exactly moreover, and quickly, in 
addition to the effect of the invention to claim 1 thru/or claim 5 , it can contribute to count reduction of block 
matching processings. 

[0062] According to invention of claim 8, in addition to the effect of the invention of claim 1 thru/or claim 6, 
flexible correspondence according to the situation of a dynamic image can be performed, and forced termination 
of block matching can be made much more efficient by taking in the technique of an escape of a retrieval 
aperture gradually. 

[0063] concrete in the approach concerning invention of claim 1 according to invention of claim 9 — and it can 
fully carry out and the same effectiveness as invention of claims 1 , such as sharp reduction of power 
consumption, can be done so. 
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DESCRIPTION OF DRAWINGS 



[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing one example for enforcing the approach concerning this invention. 
[Drawing 2] difference - it is the block diagram showing the configuration of an absolute value sum array. 
[Drawing 31 16 pixels - difference - it is the block diagram showing the example of an absolute value sum 
arithmetic circuit. 

[Drawing 4] It is the block diagram showing the example of a subtotal aggregate value accumulation circuit by 
16 lines. 

[Drawing 5] the difference at the time of using the technique by all conventional retrieval - it is the graph 
which shows the example of an experiment of the relation between the absolute value sum and the number of 
block matching. 

[Drawing 6] the difference at the time of using the technique of this example - it is the graph which shows the 
example of an experiment of the relation between the absolute value sum and the number of block matching. 
[Drawing 7] the standardized difference - it is the graph which shows the example of an experiment of the 
relation between the absolute value sum and the number of average block matching. 

[Drawing 8] It is a ** type Fig. explaining the location of the window region for retrieval which considered the 
motion vector. 

[Drawing 9] It is a graph explaining two steps of threshold setup. 

[Drawing 10] It is the graph which shows the example of an experiment of the relation between the mean 
difference part absolute value sum and the number of pixels of the retrieval range. 
[Description of Notations] 
2 Control Section, 

5 Short Range Retrieval Aperture Extract Circuit (Extract Section), 

6 Data Memory for Wide Range Retrieval Apertures, 

7 Side Register, 

8 Difference - Absolute Value Sum Array, 

9 Comparator Circuit 

10 Monitor counter. 
59 Selector. 
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CLAIMS 



[Claim(s)] 

[Claim 1] In the signal-processing approach of the dynamic-image information for presenting performing 
motion compensation prediction between two images isolated serially said motion compensation prediction The 
process which positions the short range retrieval aperture in the wide range retrieval aperture selected within the 
playback image, Between the reference macro blocks by which the location was carried out about the collating 
macro block by which a sequential setup is carried out within said short range retrieval aperture in order to have 
been referred to within the present image the difference of the pixel values to which each macro block 
corresponds ~ the difference based on an absolute value — with the process of block matching which calculates 
the absolute value sum the difference calculated about each collating macro block in said short range retrieval 
aperture by which the location was carried out, when the absolute value sum reaches a predetermined threshold 
The 1st forced-termination process which forces the process of said block matching in the short range retrieval 
aperture concerned to terminate, the difference which operated sequentially about each collating macro block by 
which a sequential setup is carried out from the wide range retrieval aperture which is the extended partition of 
said short range retrieval aperture, when the absolute value sum reaches said predetermined threshold The 2nd 
forced-termination process which forces the process of said block matching in the wide range retrieval aperture 
concerned to terminate, The 3rd forced-termination process which considers the time of all the processes of said 
block matching in all the fields in said wide range retrieval aperture being completed as the time of forced 
termination of said block matching, difference when said predetermined threshold is reached — as a collating 
macro block in case the absolute value sum serves as min The signal-processing approach of the dynamic-image 
information characterized by including the process which detects the motion vector which is the two- 
dimensional movement magnitude to the location of said reference macro block of the location of the prediction 
macro block defined. 

[Claim 2] That said motion compensation prediction is the same as that of said short range retrieval aperture and 
a wide range retrieval aperture in the screen of coding in a screen, or the screen of front predicting coding, or 
the process which positions the amendment retrieval aperture of the field of different magnitude, Between the 
reference macro blocks by which the location was carried out about the collating macro block by which a 
sequential setup is carried out within this amendment retrieval aperture in order to have been referred to within 
the present image the difference of the pixel values to which each macro block corresponds — the difference 
based on an absolute value — with the process which performs block matching for calculating the absolute value 
sum the difference obtained at the process which performs this block matching — the minimum difference of the 
absolute value sums — by adding the process which elects the absolute value sum In case said predetermined 
threshold is set up, while performing said process to elect about all reference macro blocks by which a location 
is carried out within said present image said all difference to elect and that was obtained the whole process — 
the minimum value of the absolute value sums, or said all difference — the signal -processing approach of the 
dynamic-image information according to claim 1 characterized by using the tolerance about the average, said 
minimum value, or this average of the absolute value sum. 

[Claim 3] said predetermined threshold is acquired when any one process in said 1st forced-termination process, 
the 2nd forced-termination process, and the 3rd forced-termination process is performed among all reference 
macro blocks by which the location was carried out by the last present image - each ~ difference - the signal- 
processing approach of the dynamic-image information according to claim 1 characterized by being the 
tolerance of the minimum value of the absolute value sum, or this minimum value. 

[Claim 4] the difference from which said predetermined threshold is acquired when any one process in said 1st 



forced-termination process, and the 2nd forced-termination process and the 3rd forced-termination process is 
performed between the last reference macro blocks - the absolute value sum - or — this - difference — the 
signal-processing approach of the dynamic-image information according to claim 1 characterized by being the 
tolerance of the absolute value sum. 

[Claim 5] the difference to which said 1st forced-termination process operated sequentially by the short range 
retrieval aperture concerned — the absolute value sum the difference which reached said predetermined 
threshold and was obtained one by one in the operation process concerned, when the percentage reduction of the 
absolute value sum becomes the tolerance of a zero value, said predetermined threshold, or said zero value The 
time of it coming to be considered that the percentage reduction of the absolute value sum is the tolerance of a 
zero value, said predetermined threshold, or said zero value or min is included, or the difference obtained one 
by one in the operation process concerned — the difference to which said 2nd forced-termination process 
operated sequentially by the wide range retrieval aperture concerned — the difference from which the absolute 
value sum reached said predetermined threshold, and was obtained one by one in the operation process 
concerned, when the percentage reduction of the absolute value sum becomes a zero value or its tolerance or the 
difference obtained one by one in the operation process concerned — the signal-processing approach of 
dynamic-image information given in any 1 term to claim 1 characterized by including the time of it coming to 
be considered that the percentage reduction of the absolute value sum is a zero value, its tolerance, or min 
thru/or claim 4. 

[Claim 6] Said wide range retrieval aperture is the signal-processing approach of dynamic-image information 
given in any 1 term to claim 1 characterized by being selected according to the two-dimensional movement 
magnitude obtained based on the motion vector which said prediction macro block set up immediately before 
has thru/or claim 5. 

[Claim 7] While said wide range retrieval aperture is selected according to the two-dimensional movement 
magnitude obtained based on the motion vector which said prediction macro block set up immediately before 
has, said 1st forced-termination process The absolute value sum reaches said predetermined threshold, the 
difference which operated sequentially by the short range retrieval aperture concerned — The time of the 
percentage reduction of the absolute value sum becoming a zero value or its tolerance is included, and the 
difference obtained one by one in the operation process concerned - said 2nd forced-termination process The 
absolute value sum reaches said predetermined threshold, the difference which operated sequentially by the 
wide range retrieval aperture concerned ~ and the difference obtained one by one in the operation process 
concerned — the signal-processing approach of dynamic-image information given in any 1 term to claim 1 
characterized by including the time of the percentage reduction of the absolute value sum becoming a zero 
value or its tolerance thru/or claim 4. 

[Claim 8] the difference at the time of said 3rd forced-termination process being performed, as for said motion 
compensation prediction — the signal-processing approach of dynamic-image information given in any 1 term to 
claim 1 characterized by including the process which extends gradually the field of said wide range retrieval 
aperture in the field of said playback image unless the absolute value sum reaches said predetermined threshold 
thru/or claim 7. 

[Claim 9] The control section which positions the reference macro block for being referred to within the present 
image while positioning a wide range retrieval aperture from the inside of a playback image, Between the data 
memory which memorizes said wide range retrieval aperture, a series of pixel value groups obtained from the 
collating macro block by which a sequential setup is carried out in order to perform the retrieval concerned for 
said every selected wide range retrieval aperture, and a series of pixel value groups obtained from said reference 
macro block It has an absolute value sum array, the difference based on the difference of corresponding pixel 
values — the difference which calculates the absolute value sum - In the signal processor of the dynamic-image 
information constituted so that the motion vector which is the two-dimensional movement magnitude of the 
prediction macro block location defined from the absolute value sum as a collating macro block by which the 
location was carried out at the time of the retrieval concerned to said reference macro block location might be 
detected the calculated this difference - The extract section which extracts said selected short range retrieval 
aperture by which a location is carried out for every wide range retrieval aperture, The selector which outputs 
alternatively the wide range retrieval aperture which is the extended partition of the extracted this short range 
retrieval aperture or this short range retrieval aperture, The side register which memorizes serially the part in 
which the collating macro block by which a sequential setup is carried out is included in order to perform said 
retrieval at least among the short range retrieval aperture outputted from this selector, or a wide range retrieval 



aperture, the difference which operated sequentially about each collating macro block -- with the comparator 
circuit which carries out the sequential comparison of the absolute value sum with the predetermined threshold 
set up beforehand The counter which carries out counting of the sequence of said collating macro block by 
which a sequential setup is carried out is formed. Said comparator circuit the difference which operated 
sequentially within the short range retrieval aperture concerned, when the absolute value sum reaches a 
predetermined threshold or the difference which operated sequentially about each collating macro block by 
which a sequential setup is carried out from said wide range retrieval aperture, when the absolute value sum 
reaches said predetermined threshold It is the signal processor of the dynamic-image information characterized 
by constituting said counter so that said control section may compute the vector quantity of said motion vector 
by outputting the sequence of a collating macro block of having reached said predetermined threshold according 
to the output of this sequence while outputting a predetermined output signal. 
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